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CFO 13538 US 



IMAGE PROCESSING METHOD AND APPARATUS 
AND RECORDING MEDIUM 

BACKGROUND OF THE INVENTION 
5 Field of t:he Invention 

The present invention relates to an image 
processing method and apparatus , for correcting an 
image, and to a recording medium. 
Related Background Art 
XO Various algorithms have been proposed for use in 

correcting the highlighting , shadow, contrast and white 
balance for an image recorded by a digital camera. 

However, even when adjustments are made for 
highlighting, shadow, contrast and white balance, the 
15 image quality provided by a digital camera that 

faithfully reproduces the color of an object is not as 
satisfactory as is the image quality provided by silver 
halide photography. 

This is true because with silver halide film 
20 desired colors are reproduced. That is, so-called 
memory colors in particular, such as the colors of 
skin, the sky, and glass, are not . always faithfully 
reproduced, but rather, color tones are shifted and 
colors are reproduced in accordance with individual 
25 preferences. Such color tone shifting is performed for 
images recorded using silver halide film. 
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SUMMARY OF THE INVENTION 

It: is, therefore, one objective of the present 
invention to provide a method whereby, to reproduce 
preferred colors, corrections are made to an image 
5 recorded using a specific input device so that the 

tones and colors of the image more nearly correspond to 
those that would be produced using silver halide film. 

To achieve the above objective, according to a 
first aspect of the present invention, an image 
10 processing method comprises the steps of: 

holding a profile for an input device and a 
profile for an output target film; 

preparing a table to approximate a color 
reproducibility of an output target film as to a color 
15 reproducibility of input image data on the basis of the 
profile for the input device and the profile for the 
output target film; and 

correcting the color of the input image data by 
using the prepared table. 
20 According to a second aspect of the present 

invention, an image processing method comprises the 
steps of: 

correcting a color of input image data by using a 
table prepared on the basis of a color reproducibility 
25 for input image data and a color reproducibility for an 
output target; and 

emphasizing an edge of a highlighted portion of 
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the image data obtained by color correction . 

Objectives and advantages other than those 
discussed above will become apparent to those skilled 
in the art during the course of the description of the 
5 preferred embodiments of the invention that follows. 
In the description, reference is made to accompanying 
drawings, which form a part thereof and which 
illustrate an example of the invention. Such a 
description, however, is not an exhaustive recital of 
10 the various possible embodiments of the invention, and 
reference is therefore made to the claims that follow 
the description for a determination of the scope of the 
invention . 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram illustrating the arrangement 
of an image correction apparatus according to a first 
embodiment of the present invention; 

Fig. 2 is a flowchart showing the processing 
20 according to the first embodiment of the present 
invention; 

Fig. 3 is a diagram showing data held in a input 
device profile holding unit; 

Fig. 4 is a diagram showing data held in an output 
25 target film profile holding unit; 

Fig. 5 is a flowchart showing the processing 
performed by a lookup table preparing unit; 
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Fig. 6 is a diagram showing an example lookup 
table held in a lookup table holding unit; 

Fig, 7 is a flowchart showing the processing 
performed by an image correcting unit according to the 
5 first embodiment of the present invention; 

Fig, 8 is a graph showing an example profile for 
an input device; 

Fig. 9 is a graph showing an example profile for 
an output film; 
10 Fig. 10 is a flowchart showing the processing 

performed by an output device selecting unit; 

Fig. 11 is a flowchart showing the processing 
performed by an edge emphasis processing unit; 

Fig. 12 is a diagram illustrating the arrangement 
15 of an image correcting apparatus according to a second 
embodiment of the present invention; 

Fig. 13 is a flowchart showing the processing 
performed for the second embodiment of the present 
invention; 

20 Fig. 14 is a flowchart showing the processing 

performed by a histogram preparing unit; 

Fig. 15 is a graph showing an example histogram 
that has been prepared; 

Fig. 16 is a flowchart showing the processing 
25 performed by a lookup table preparing unit in Fig. 12; 

Figs. 17A and 17B are diagrams showing example 
lookup tables held in a lookup table holding unit in 
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Fig- 12; 

Fig. 18 is a flowchart showing the processing 
performed by an image correcting unit according to the 
second embodiment of the present invention; 
5 Fig. 19 is a diagram illustrating the arrangement 

of an image correcting apparatus according to a third 
embodiment of the present invention; 

Fig, 20 is a flowchart showing the processing 
performed for the third embodiment of the present 
10 invention; 

Fig. 21 is a diagram showing image data and an 
image header stored in an image buffer; 

Fig. 22 is a flowchart showing the processing 
performed by a lookup table preparing unit when an 
15 input device is other than a digital camera; and 

Fig. 23 is a flowchart showing the processing 
performed by an output device selecting unit. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
20 The preferred embodiments of the present invention 

will now be described while referring to the 

accompanying drawings. 

(First Embodiment) 

Fig. 1 is a diagram showing the arrangement of the 
25 essential portion of an image correction apparatus 

according to a first embodiment of the present 

invention. 
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The image correction apparatus in Fig. 1 
comprises: an image inputting unit 2, an image 
outputting unit 3, an image buffer 4, an input device 
profile holding unit 5, an output target film profile 
5 holding unit 6, an input/output device selecting unit 
7 , a lookup table preparing unit 8, a lookup table 
holding unit 9, an image correcting unit 10, an edge 
emphasis processing unit 12, and an image buffer 13 for 
copy. 

10 The image inputting unit 2 reads data from an 

input image 1, and writes the data in the image buffer 
4. The image outputting unit 3 writes, as an output 
image, the data stored in the image buffer 4 wherein 
the image data are held. The input device profile 

15 holding unit 5 holds profiles for several types of 

input devices and for an input device that is currently 
being selected. The output target film profile holding 
unit 6 holds profiles for several types of films to be 
output and an output film that is currently being 

20 selected. The input/output device selecting unit 7 

selects an input device and stores the selected input 
device type in the input device profile holding unit 5, 
and selects an output target film and stores the 
selected film type in the output target film profile 

25 holding unit 6. The lookup table preparing unit 8 

prepares a lookup table by employing the data stored in 
the input device profile holding unit 5 and in the 
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output target film profile holding unit 6, and stores 
the lookup table in the lookup table holding unit 9. 
Based on the lookup table held in the lookup table 
holding unit 9, the image correcting unit 10 corrects 
5 image data stored in the image buffer 4. The edge 

emphasis processing unit 12 emphasizes the edge of a 
highlighted portion. The image buffer 13 used for copy 
is used for the temporarily storage of a copy of the 
image data held in the image buffer 4 when the edge 

10 emphasis processing is performed. 

The operation of the image correction apparatus 
can be implemented by supplying to a personal computer, 
for example, a program for performing, or for 
exercising control of the operations of the individual 

15 sections. In this case, the CPU of the personal 
computer performs, or exercises control of the 
individual section operations based on the contents of 
the supplied program. 

The first embodiment of the present invention will 

20 now be described in detail by employing a specific 
example . 

Fig. 2 is a flowchart showing the processing for 
the first embodiment. 

At step Sll, an input image is read from the image 
25 inputting unit 2, and the image data are stored in the 
image buffer 4. 

At step S12, the lookup table preparing unit 8 
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prepares a lookup table. The detailed operation of the 
lookup table preparing unit 8 will be described later 
while referring to Fig. 5. 

At S13, the image correcting unit 10 corrects an 
5 image. The detailed operation of the image correcting 
unit 10 will be described later while referring to Fig. 
7. 

At step S14 the edge emphasis processing unit 12 
performs an operation to emphasize the edge of a 
10 highlighted portion. The detailed operation performed 
by the edge emphasis processing unit 12 will be 
described later while referring to Fig. 11. 

At step SI 5 the contents of the image buffer 4 are 
written to the output image buffer 11 by the image 
15 outputting unit 3. 

Fig. 3 is a diagram showing the data structure of 
an input device profile held in the input device 
profile holding unit 5. 

The input device profile has a two-dimensional 
20 data structure that consists of the patch numbers of 
individual gray scales, and the corresponding RGB 
values of input devices. When the number of input 
device types is increased, only the RGB values for 
individual patches of corresponding gray scales need be 
25 measured and added to the table. 

The type of device that is currently being 
selected is also held in the input device profile 
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holding unit 5- This device type can be changed by the 
input /output device selecting unit 7, In the initial 
state, either one of the devices is selected. 

Fig, 4 is a diagram showing the data structure of 
5 an output target film profile that is held in the 
output target film profile holding unit 6. 

The output target film profile has a two- 
dimensional data structure that consists of the number 
of patches of gray scales and the corresponding RGB 
10 values of output target films. When the number of 
output target film types is increased, only the RGB 
values for the patches corresponding to the gray scales 
need be measured and added to the profile. 

The type of film that is currently being selected 
15 is also held in the film profile holding unit 6. The 
film type can be changed by the input/output device 
selecting unit 7. In the initial state, either one of 
the devices is selected. 

The operation performed by the input/output device 
20 selecting unit 7 is shown in Fig. 10. 

At step S41, the name of an input device is 
selected and is stored in the input device profile 
holding unit 5. When, for example, a profile 
conforming to the ICC standard is added to the input 
25 image data, the name of the input device is 

automatically selected based on the header information 
for the profile. When a profile is not added to the 
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input image data, the name of the input device is 
selected based on an instruction issued by a user that 
is entered at a user interface that is unique to the 
image correction apparatus of the present invention and 
5 that is displayed on the monitor of a personal 
computer . 

At step S42, the name of an output film is 
selected and is stored in the output target film 
profile holding unit 6. As the name of the output 

10 film, the name of an output device is selected based on 
an instruction issued by a user that is entered at a 
user interface that is unique to the image correction 
apparatus of the present invention. 

The name of an input device and the name of an 

15 output film can be selected at any time, except during 
the correction processing. 

The operation performed by the lookup table 
preparing unit 8 is shown in Fig. 5, which is a 
detailed diagram of the operation performed at step S12 

20 in Fig. 2. 

At step S21, a one-dimensional lookup table for 
individual RGB color components is prepared based on 
the input device profile and the output target film 
profile that are selected by the input/output device 

25 selecting unit 7. In this embodiment, a lookup table 
shown in Fig. 6 is prepared with which input device 
profile data corresponding to the same patch are 
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converted into data for the output target film profile. 
The individual points at which data are not stored in 
the profile are linearly interpolated with each other, 
and conversion data are prepared. At both ends, points 
5 (255, 255) and (0, 0) are linearly interpolated. 

Although linear interpolation is employed for this 
embodiment, non- linear interpolation using a spline 
curve or a Bezier curve may be employed. 

At step S22, the obtained lookup table is stored 
10 in the lookup table holding unit 9. 

Fig. 7 is a flowchart showing the processing 
performed by the image correcting unit 10. This is a 
detailed diagram of the operation performed at step S13 
in Fig. 2. 

15 At step S31, image data for one pixel are read 

from the image buffer 4 and are corrected by referring 
to the lookup table held in the lookup table holding 
unit 9, and are then used to overwrite data recorded in 
the image buffer 4. 

20 As is described above, for the image correction 

process performed in this embodiment, tone reproduction 
and color reproduction are corrected in accordance with 
the tone reproduction for the output target film. 

In this embodiment, a lookup table is prepared for 

25 each color component in order to increase the speeds at 
which the lookup table is prepared and for preparing 
the lookup table and at which image data is corrected. 
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Furthermore, data concerning gray scales are stored in 
a profile in order to quickly prepare the lookup table 
with which both tone reproduction and color 
reproduction can be preferably corrected. As a result, 
5 the gray level that is important for the reproduction 

of tones can be preferably reproduced by using the gray 
scales, and the color balance can be corrected. 

Fig. 11 is a flowchart showing the processing 
performed by the edge emphasis processing unit 12. 

10 This is a detailed diagram of the operation performed 
at step S14 in Fig. 2. 

When at step S13 an image is corrected by using 
the lookup table prepared at step S12 in Fig. 2, the 
colors that are reproduced for an output image can 

15 resemble those for the selected film. Generally, 
however, in a highlighted portion the operation 
performed at step S13 tends to sacrifice individual 
color component tones in order to obtain a preferable 
contrast for these color components in a half-tone 

20 portion. Therefore, the edge emphasis processing unit 
is employed to compensate for the lack of tones in the 
highlighted portion. 

First, at step S51 RGB luminance data for one 
pixel are read from the image buffer 4. 

25 At step S52, for each RGB pixel the obtained RGB 

luminance data are compared with a threshold value. 
When all the RGB luminance data are smaller than the 
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threshold value, or are for pixels at the ends of an 
image, program control moves to step S54. In the other 
case, program control goes to step S53. 

At step S53, a 3 x 3 edge emphasis filter is used 
5 to filter color component data that are equal to or 

greater than the threshold value- Color component data 
that are smaller than the threshold value are not 
filtered. 

At step S54, the obtained RGB luminance data are 
10 written in the image buffer 13 for copy. When the edge 
emphasis processing is not performed, the RGB data 
fetched at step S51 are written unchanged in the image 
buffer 13. 

At step S55, a check is performed to determine 
15 whether all the pixels have been processed. When all 
the pixels have been processed, program control 
advances to step S56. When all the pixels have not 
been processed, program control returns to step S51. 

At step S56 all the contents of the image buffer 
20 13 for copy are copied to the image buffer 4. 

The threshold value used at step S52 may be the 
same for all the color components, or may differ for 
each color component. 

According to the first embodiment, an image 
25 obtained by a specific input device can resemble an 

image reproduced using a specific film. For example, a 
lookup table is prepared with which the tone 
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characteristic for an input device in Fig- 8 is 
converted into a tone characteristic for a silver 
halide film shown in Fig. 9, so that an image obtained 
by a specific device can approximate an image 
5 reproduced by using a specific silver halide film- As 
a result, preferable tone reproduction and desired 
color reproduction can be easily implemented. The 
desired color reproduction is a very effective means 
for enhancing the quality of an image recorded by an 

10 input device, such as a digital camera. 

Since a plurality of output target film profiles 
are stored, the characteristics of various films can be 
coped with. Thus, the tone reproduction and color 
reproduction desired by a user can be provided. 

15 There are many input device types and also many 

color shifting methods for obtaining preferable color 
reproduction. In this embodiment, therefore, an input 
device profile and an output target film profile are 
separately stored in order to cope with various 

20 combinations of an input device and an output target 
film. Further, when the number of input device types 
and the number of output target files are increased, 
only the profiles of corresponding devices or films 
need be added. 

25 Since an image obtained by an input device is so 

corrected that tones and colors of the image are 
similar to those produced by using a silver halide 
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film, and since edge emphasis processing is performed 
to obtain preferable tones in a highlighted portion , an 
image having a high quality can be output. 
(Second Embodiment) 
5 For image correction in a second embodiment, in 

addition to the processing explained for the first 
embodiment, a lookup table is prepared based on a 
histogram for an input image. 

The second embodiment will now be described while 
10 referring to the accompanying drawings. No detailed 
explanation will be given for arrangements and 
processing that correspond to those in the first 
embodiment . 

Fig. 12 is a diagram illustrating the arrangement 
15 of the essential portion of an image correction 

apparatus according to the second embodiment of the 
present invention . 

The image correction apparatus in Fig. 12 
comprises: an image inputting unit 2, an image 
20 outputting unit 3, an image buffer 4, an input device 
profile holding unit 5, an output target film profile 
holding unit 6, an input/output device selecting unit 
7, a lookup table preparing unit 8, a lookup table 
holding unit 9, an image correction unit 10, an edge 
25 emphasis processing unit 12, an image buffer 13 for 
copy, a histogram preparing unit 14, and a histogram 
holding unit 15 . 
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The image inputting unit 2 fetches data from an 
input image 1 and writes them in the image buffer 4, 
and the image outputting unit 3 writes to an output 
image 11 data written in the image buffer 4, which is 
5 used to store image data. The input device profile 

holding unit 5 holds profiles for several input device 
types and for an input device that is currently 
selected. The output target film profile holding unit 
6 stores profiles for several output film types and for 

10 an output film that is currently selected. The 

input /output device selecting unit 7 selects an input 
device and stores its name in the input device profile 
holding unit 6, and also selects an output target film 
and stores its name in the output target film profile 

15 holding unit 6. Based on a histogram stored in the 

histogram holding unit 15, the lookup table preparing 
unit 8 calculates parameters required for correction, 
and prepares a lookup table and stores it in the lookup 
table holding unit 9. Also, based on data stored in 

20 the input device profile holding unit 5 and the output 
target film profile holding unit 6, the lookup table 
preparing unit 8 prepares a lookup table and stores it 
in the lookup table holding unit 9, which is used to 
store lookup tables. The image correcting unit 10 

25 synthesizes the two types of tables stored in the 
lookup table holding unit 9 and corrects an image 
stored in the image buffer 4. The edge emphasis 
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processing unit 12 emphasizes the edges of a 
highlighted portion. The image buffer 13 for copy is 
used to temporarily copy the contents of the image 
buffer 4 to perform edge emphasis processing. The 
5 . histogram preparing unit 14 prepares a histogram based 
on image data stored in the image buffer 4 and stores 
the histogram in the histogram holding unit 15. The 
histogram holding unit 15 is used to store the 
histogram for all the image data. 

10 The image correction apparatus can be implemented 

by supplying to a personal computer, for example, a 
program for performing, or for exercising control of 
the operations of the individual sections in Fig. 12. 
In this case, the CPU of the personal computer 

15 performs, or exercises control of the individual 
section operations based on the contents of the 
supplied program. 

The processing performed for the second embodiment 
will now be described in detail by employing a specific 

20 example. 

< Image processing in the second embodiment > 

Fig. 13 is a flowchart showing the processing for 
the second embodiment. 

At step S201, an input image 1 is fetched from the 

25 image inputting unit 2, and the image data are stored 
in the image buffer 4. 

At step S202, the histogram preparing unit 14 
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prepares a histogram based on the image data stored in 
the image buffer 4, and stores the histogram in the 
histogram holding unit 15- The detailed operation of 
the histogram preparing unit 14 will be described later 
5 while referring to Fig. 14. 

At step S203, the lookup table preparing unit 8 
prepares a lookup table. The detailed operation of the 
lookup table preparing unit 8 will be described later 
while referring to Fig. 16. 
10 At step S204, the image correcting unit 10 

corrects an image. The detailed operation of the image 
correcting unit 10 will be described later while 
referring to Fig. 18. 

At step S205, the edge emphasis processing unit 12 
15 emphasizes the edges of the highlighted portion in the 
same manner as described in the first embodiment. 

At step S206, the contents of the image buffer 4 
are written to the output image buffer 11 by the image 
outputting unit 3. 
20 <Histogram preparing process> 

The operation performed by the histogram preparing 
unit 14 is shown in Fig. 14, which is a detailed 
flowchart of step S220 in Fig. 13. 

At step S211, image data for one pixel are 
25 extracted from the image buffer 4. The luminance (R, 

G, B) for each of the RGB color components is stored as 
image data. 
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At step S212 the RGB image data values are 
employed to calculate luminance L for a relevant pixel 
by using the following equation. 

L - (3*R + 6*G + 1*B)/10 
5 At step S213, the histogram stored in the 

histogram holding unit 15 is updated. The histogram 
holding unit 15 holds histogram HistL for the obtained 
luminance L, and HistR, HistG and HistB in which the 
cumulative luminance values of the RGB colors are 
10 stored in accordance with the luminance L of the 

relevant pixel. The histograms are all set to 0 in the 
initial state. 

Updating of the histogram is performed as follows. 

HistR[L] = HistR[L] + R 
15 HistG[L] = HistG [L] + G 

HistB [L] - HistB [L] + B 

HistL[L] = HistL[L] = 1 

At step S214, a check is performed to determine 
whether all the pixels have been processed. When all 
20 the pixels have been processed, the processing is 

thereafter terminated. When not all the pixels have 
been processed, program control returns to step S211. 

The histogram HistL that is prepared is shown in 
Fig. 15. 

25 < Lookup table preparation process > 

The operation performed by the lookup table 
preparing unit 8 is shown in Fig. 16, which is a 
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detailed flowchart for step S203 in Fig. 13. 

At step S221, the maximum luminance of an image is 
obtained from the histogram stored in the histogram 
holding unit 15. Thus, for the histogram in Fig, 15 
5 the maximum luminance is 252. 

At step S222, the luminance LH ! , obtained by 
subtracting from 255 a predetermined value (10 in Fig. 
15), is compared with the maximum luminance. That is, 
in this example, the values 255, 245, 235, . . . are 

10 obtained by subtraction, and each resultant value is 

compared with the maximum luminance value. In Fig. 15 , 
LH f = 245. When the maximum luminance value is greater 
than the luminance LH 1 , an area including pixels at a 
predetermined ratio (in Fig. 15, 1% of the total 

15 pixels) is obtained. The minimum luminance in that 

area is defined as a highlighted point LH ( LH = 234 in 
Fig. 15). The average luminance (RH, GH, BH) of RGB in 
an area wherein the luminance is equal to or higher 
than LH and equal to or lower than LH 1 is calculated by 

20 using the following equations. 

LH f Ui f 

RH = HistRim] I HistLlm] 

m*LH m'LH 



25 



GH = H±stG[m\ / £ HistLim] 
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Ui ! LH f 

BH = Y, HzstB[m] / £ HistL[m] 

m*LH m=LH 

At step S223, the minimum luminance level of an 
5 image is obtained from the histogram HistL stored in 

the histogram holding unit 4. The minimum luminance is 
5, according to the histogram in Fig* 15. 

At step S224, a predetermined value (10 in Fig. 
15) is added to the luminance level, beginning with 0, 

10 and the resultant value LS 1 is compared with the 

minimum luminance level obtained at step S223. When 
the minimum luminance is smaller than the luminance LS T 
(10 in Fig. 15), an area including pixels at a 
predetermined ratio (in Fig. 15, 1% of the total 

15 pixels) is acquired. The maximum luminance in that 

area is defined as a shadow point LS (LS = 22 in Fig. 
15). The average luminance (RS, GS, BS ) of RGB in an 
area wherein the luminance is equal to or higher than 
LS 1 and equal to or lower than LS is calculated by 

20 using the following equations. 

LS LS 
m=LS' m~LS f 

LS LS 

GS = ]£ HistG[m\ / HistLlm] 

25 m-LS f m=LS f 
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LS LS 

BS = Y, HistBlm]/ £ HistLim] 

At step S225, lookup tables LUTR, LUTG and LUTB 
5 for individual RGB values are prepared by using the 

obtained RH, GH, BH, RS, GS and BS. The thus prepared 
lookup tables, for which a detailed explanation will be 
given later, are shown in Fig. 17A. These tables are 
stored in the lookup table holding unit 9. 

10 At step S226, based on the profiles selected for 

the input device and the output target film by the 
input /output device selecting unit 7, one-dimensional 
lookup tables LUTRDD, LUTGDD and LUTBDD are prepared 
for individual RGB color components in the same manner 

15 as in the first embodiment. The thus prepared lookup 
tables, for which an explanation will be given later, 
are shown in Fig. 17B. 

At step S227, the obtained lookup tables are 
stored in the lookup table holding unit 9. 

20 The lookup tables LUTR, LUTG and LUTB, shown in 

Fig. 17A, are used to correct the color contrast and 
for the assimilation of color. In this embodiment, 
gamma for highlighting is set in the descending order 
G, B and R. Since G and B are exaggerated relative to 

25 R, the assimilation of color (color fog) of an image 
that appears bluish can be corrected. At the same 
time, the color contrast can be corrected. 
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The lookup table in Fig. 17B is -the "table with 
which data from the input device profile corresponding 
to the same patch are converted into data for the 
output target film profile- The points for which no 
5 data are stored in the profile are linearly- 
interpolated and conversion data are prepared. At both 
ends, points (255, 255) and (0, 0) are linearly 
interpolated. While linear interpolation is employed 
in this embodiment, non- linear interpolation using a 
10 spline curve or a Bezier curve, for example, may be 
employed . 

< Image correction process > 

The processing performed by the image correcting 
unit 10 is shown in Fig. 18, which is a detailed 
15 flowchart for step S204 in Fig. 13. 

At step S231 new lookup tables are prepared by 
synthesizing the two types of lookup tables stored in 
the lookup table holding unit 9 using the following 
equations . 
20 LUTTmpR [ i ] = LUTRDD [ LUTR [ i ] ] 

LUTTmpG [ i ] = LUTGDD [ LUTG [ i ] ] 

LUTTmpB[i] = LUTBDD [ LUTB [ i ] ] 
In these equations, i is a value that is equal to or 
greater than 0, and is equal to or smaller than the 
25 maximum luminance value. 

At step S232, image data for one pixel is 
extracted from the image buffer 4. Individual RGB 
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luminance values (R, G, B) are stored as image data. 

At step S233, the image data extracted from the 
image buffer 4 are corrected based on the obtained 
lookup tables LUTRTmp , LUTGTmp and LUTBTmp, and the 
5 resultant image data are used to overwrite the original 
location. 

R « LUTTmpR[R] 

G - LUTTmpG[G] 

B = LUTTmpB[B] 

10 At step S234, a check is performed to determine 

whether image data for all the pixels have been 
corrected. When the correction process has been 
completed for all the pixels, the processing is 
thereafter terminated- When the correction process has 

15 not been completed for all the pixels, program control 
returns to step S232. 

As is described above, in the image processing for 
this embodiment, optimal correction provided for white 
balance and for color contrast is performed for each 

20 image, and tone reproduction and color reproduction are 
corrected in accordance with the tone reproduction 
characteristics of the output target film. 

In this embodiment, a lookup table is prepared for 
each color component in order to increase the speeds 

25 for the preparation of a lookup table and for image 

correction. In addition, data concerning a gray scale 
is stored in a profile, so that a lookup table can be 
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quickly prepared with which both tone reproduction and 
color reproduction can be preferably corrected. By 
employing the gray scale, the gray level that is 
important for tone reproduction can be preferably 
5 reproduced, and color balance can be corrected. 

In this embodiment, digital values of 0 to 255 are 
employed to describe luminance data; however, the 
maximum data value is not limited to 255, and instead 
of the luminance value, printing dot density may be 

10 employed. 

Further, at step S212 the luminance value is 
calculated by weighting the luminance value at a ratio 
of R:G:B = 3:6:1; however, other weighting may be 
employed for the calculation, or the average of a 

15 maximum RGB value and a minimum RGB value may be 
employed. 

(Third Embodiment) 

In a third embodiment, an image correction process 
is changed in accordance with whether an input device 
20 is a digital camera. 

Since correction for color assimilation and 
contrast based on the histogram explained in the second 
embodiment is a process employing the distribution of 
colors for an input image, regardless of the input 
25 device, preferable results can be obtained. However, 
since the digital development correction as explained 
in the first and the second embodiments is a process 
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for adjusting the tone characteristics of an output 
image to conform to the tone characteristics of an 
arbitrary film, the quality of an output image may be 
deteriorated if the input image has the tone 
5 characteristics of the relevant film. In other words, 
digital development may not be good for a silver halide 
image that is read by a scanner, or an image that is 
read by a film scanner. 

Therefore, in this embodiment, when an input 

10 device is a digital camera, the same process as in the 
second embodiment is performed, and when the input 
device is not a digital camera, only the correction of 
color assimilation and contrast is performed; digital 
development correction is not performed. 

15 No detailed explanation will be given for 

arrangements and processing that correspond to those in 
the first and the second embodiments. 

Fig. 19 is a diagram showing the arrangement of 
the essential portion of an image correction apparatus 

20 according to the third embodiment. 

The image correction apparatus in Fig. 19 
comprises: an image inputting unit 2, an image 
outputting unit 3, an image buffer 4, an input device 
profile holding unit 5, an output target film profile 

25 holding unit 6, an output device selecting unit 7, a 
lookup table preparing unit 8, a lookup table holding 
unit 9, an image correcting unit 10, an edge emphasis 
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processing unit 12, an image buffer 13 for copy, a 
histogram preparing unit 14, a histogram holding unit 
15, and an image judging unit 16. 

The image inputting unit 2 fetches data from an 
5 input image 1, and writes them in the image buffer 4. 
The image outputting unit 3 writes data stored in the 
image buffer 4 to an output image 11. The image buffer 
4 is used to store image data. The input device 
profile holding unit 5 holds profiles for several input 

10 device types and for an input device that is currently 
selected. The output target film profile holding unit 
6 stores profiles for several output film types and for 
an output film that is currently selected- The output 
device selecting unit 7 also selects an output target 

15 film and stores its name in the output target film 

profile holding unit 6. Based on a histogram stored in 
the histogram holding unit 15, the lookup table 
preparing unit 8 calculates parameters required for 
correction, and prepares a lookup table and stores it 

20 in the lookup table holding unit 9. Also, when an 

input device is a digital camera, based on data stored 
in the input device profile holding unit 5 and the 
output target film profile holding unit 6, the lookup 
table preparing unit 8 prepares a lookup table and 

25 stores it in the lookup table holding unit 9, which is 
used for the storage of lookup tables. The image 
correcting unit 10 corrects an image stored in the 
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image buffer 4 based on the lookup -table stored in the 
lookup table holding unit 9. The edge emphasis 
processing unit 12 emphasizes the edges of a 
highlighted portion. The image buffer 13 for copy is 
5 used to temporarily hold a copy of the contents of the 
image buffer 4 when edge emphasis processing is 
performed. The histogram preparing unit 14 prepares a 
histogram based on image data stored in the image 
buffer 4, and stores the histogram in the histogram 

10 holding unit 15. The histogram holding unit 15 is used 
to store the histogram for all the image data. The 
image judging unit 16 determines what type of image is 
being processed. 

An image correction apparatus can be implemented 

15 by supplying to a personal computer , for example, a 
program for performing, or for exercising control of 
the operations of the individual sections in Fig. 19. 
In this case, the CPU of the personal computer 
performs, or exercises control of the individual 

20 section operations based on the contents of the 
supplied program. 

The third embodiment will now be described in 
detail by employing a specific example. 

Fig. 20 is a flowchart showing the processing 

25 performed for the third embodiment - 

At step S301, image data for an input image 1 and 
an image header are read by the image inputting unit 2, 
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and are stored in the image buffer 4. 

At step S302, the image judging unit 16 determines 
the image type. Specifically, the image judging unit 
16 employs an ID entered in the image header to 
5 determine whether the input device used for the image 
was a digital camera or another device. 

Fig. 21 is a diagram showing the contents of the 
image data and the image header stored in the image 
buffer 4. 

10 The ID of the input device is included with the 

image data, which represent the RGB values of 
individual pixels, and the image judging unit 16 
examines the ID to determine the type of input device, 
which may be, for example , a digital camera, a file 

15 scanner, or a flat bed scanner. An input device 

profile is automatically selected in accordance with 
the input device ID stored in the image header. 

When, at step S302, it is ascertained that the 
input device is a digital camera, program control moves 

20 to step S303. When the input device is a device other 
than a digital camera, program control goes to step 
S308. 

At step S303, the histogram preparing unit 14 
prepares a histogram based on the image data stored in 
25 the image buffer 4 and stores it in the histogram 
holding unit 15. 

At step S304, the lookup table preparing unit 8 
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prepares a lookup table. 

At step S305, the image correcting unit 10 
cor r ec t s an image - 

At step S306, the edge emphasis processing unit 12 
5 emphasizes the edges of a highlighted portion. 

The processes at steps S303 to S306 are the same 
as those at steps S202 to S205 in Fig. 13 that were 
explained in the second embodiment. 

At step S307, the data in the image buffer 4 are 
10 written by the image outputting unit 3 to an output 
image 11. 

At step S308, the histogram preparing unit 14 
prepares a histogram based on the image data stored in 
the image buffer 4 and stores it in the histogram 
15 holding unit 15. This process is the same as the one 
performed at step S303. 

At step S309, the lookup table preparing unit 8 
prepares a lookup table. 

The operation of the lookup table preparing unit 8 
20 when the input device is a digital camera is shown in 
Fig, 22. The processes at steps S351 to S355 are the 
same as those at steps S221 to S225 in Fig. 16 that 
were explained in the second embodiment. 

At step S310, the image correcting unit 10 
25 corrects an image. This process is the same as the one 
performed at step S305. 

<Process for changing a selected profile> 
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The operation of -the output device selecting unit 
7 is shown in Fig. 23. 

At step S361, the name of an output film is 
selected and is stored in the output target film 
profile holding unit 6. The name of an output device 
is selected as the name of an output film in accordance 
with an instruction that is entered by a user at a user 
interface that is unique to the image correction 
apparatus of the present invention. 

The selection of the output film name can be 
performed any time except during the correction 
process . 

In this embodiment, the input device is 
automatically selected in accordance with the ID of the 
input device that is stored in the image header of the 
image data. However, a user may manually select the 
input device. 
(Other Embodiments) 

In addition, the scope of the present invention 
may also include an embodiment wherein software program 
code for accomplishing the functions of the embodiments 
is loaded into a computer (a CPU or an MPU) in an 
apparatus, or in a system, that is connected to various 
devices in order to operate them, so that the devices 
are operated by the computer in the system, or in the 
apparatus, in accordance with the stored program. 

In this case, the program code implements the 
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innovative functions provided by the present invention, 
and the means for supplying the program code to the 
computer, e.g., the memory medium on which the program 
code is stored, accomplishes the present invention. 
5 A memory medium on which the program code is 

recorded is, for example, a floppy disk, a hard disk, 
an optical disk, a magneto optical disk, a CD-ROM, a 
magnetic tape, a nonvolatile memory card, or a ROM. 
Another embodiment of the present invention 

10 consists of an application wherein, to accomplish the 
functions of the above embodiments, not only does a 
computer execute program code that is supplied , but in 
addition, the program code interacts either with an OS 
(Operating System) that is running on the computer or 

15 with another software program. 

Furthermore, to accomplish the functions included 
in the above embodiment, the present invention also 
provides for program code to be stored in memory 
mounted on a function expansion board in a computer, or 

20 in memory mounted in a function expansion unit 

connected to the computer, and for, in consonance with 
instructions included in the program code, a CPU 
mounted on the function extension board or mounted in 
the function extension unit to perform a part or all of 

25 the processing. 

Although the present invention has been described 
in its preferred form with a certain degree of 
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particularity, many apparently widely different 
embodiments can be devised without departing from the 
spirit and the scope of the invention. It is therefore 
to be understood that the invention is not limited to 
specific embodiments described herein, except as 
defined in the appended claims. 
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WHAT IS CLAIMED IS: 

1. An image processing method comprising the 
steps of: 

holding a profile for an input device and a 
profile for an output target film; 

preparing a table to approximate a color 
reproducibility of output target film as to a color 
reproducibility of the input image data on the basis of 
the profile for the input device and the profile for 
the output target film; and 

correcting a color of the input image data by 
using the prepared table, 

2. An image processing method according to claim 
1, wherein data corresponding to a gray chart is 
described in the profile for the input device and the 
profile for the output target film. 

3. An image processing method according to claim 
1, further comprising the step of: 

selecting the profile for the input device on the 
basis of information added to an input image. 

4. An image processing method according to claim 
1, wherein the table is prepared for each of color 
components of the input image data. 
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5. An image processing method comprising the 
steps of : 

correcting a color of input image data by using a 
table prepared on the basis of a color reproducibility 
5 for the input image data and a color reproducibility 
for an output target film; and 

emphasizing an edge in a highlighted portion of 
the color-corrected image data. 

10 6. An image processing method according to claim 

1, further comprising the steps of: 

performing a white balance correction using a look 

up table prepared on the basis of a highlighted point 

and a shadow point of the input image data; and 
15 performing the color correction for the image data 

obtained by the white balance correction. 

7. An image processing method according to claim 
1, further comprising the steps of: 
20 judging a type of an input device type according 

to an input image; and 

determining, in accordance with a result obtained 
in said judging step, whether the color correction is 
to be performed. 

25 

8- An image processing method according to claim 
7, wherein the type of the input device is described as 
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an ID, within header information for the input image. 

9. An image processing method according to claim 
7, wherein the type of the input device is name of a 
digital camera, a film scanner or a flat bed scanner. 

10. An image processing method according to claim 

9, wherein the color correction is performed when the 
type of the input device is a digital camera. 

11. An image processing method according to claim 

10, where, when said input device type is a digital 
camera, the profile for the input device is 
automatically selected in accordance with the name of 
the device. 

12. An image processing apparatus comprising: 
holding means for holding a profile for an input 

device and a profile for an output target film; 

preparation means for preparing a table to 
approximate a color reproducibility of an output target 
film as to a color reproducibility of input image data 
on the basis of the profile for the input device and 
the profile for the output target film; and 

color correction means for correcting the color of 
the input image data by using the prepared table. 
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13 • A recording medium on which an image 
processing program is stored, said program comprising 
the steps of: 

reading out a profile for an input device and a 
5 profile for an output target film; 

preparation means for preparing a table to 
approximate a color reproducibility of an output target 
film as to a color reproducibility of input image data 
on the basis of the profile for the input device and 
10 the profile for the output target film; and 

correcting the color of the input image data by 
using the prepared table. 
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ABSTRACT OF THE DISCLOSURE 

Disclosed is an image processing method. 

According -to "the present: invention, an image 
processing method comprises the steps of retaining on 
5 file a profile for an input device and a profile for an 
output target film, employing the profiles for the 
input device and for the output target film to prepare 
a color reproduction table to facilitate the input of 
image data that is near that of the output target film, 
10 and correcting the colors of the input image data in 
accordance with the table that is prepared. 
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PREPARE LOOKUP TABLE ON THE BASIS OF PROFILE 
DATA HELD IN INPUT DEVICE PROFILE HOLDING UNIT 5 
AND OUTPUT TARGET FILM PROFILE HOLDING UNIT 6 
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STORE RESULT IN LOOKUP TABLE HOLDING UNIT 9 
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CORRECT CONTENT OF IMAGE BUFFER 4 ONE PIXEL 
BY ONE PIXEL, ON THE BASIS OF LOOKUP TABLE 
HELD AT LOOKUP TABLE HOLDING UNIT 9 
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SELECT INPUT DEVICE NAME, AND STORE SERULT 
IN INPUT DEVICE PROFILE HOLDING UNIT 5 
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SELECT OUTPUT FILE NAME, AND STORE RESULT IN 
OUTPUT TARGET FILM PROFILE HOLDING UNIT 6 
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FIG. 17 A 

LUT FOR CORRECTING COLOR FOG 
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FIG. 17B 

LUT FOR DIGITAL DEVELOPMENT 
LUTRDD LUTBDD 




LUMINANCE OF 
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LUMINANCE OF IMAGE OF INPUT DEVICE 
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FETCH IMAGE DATA OF ONE PIXEL 
FROM IMAGE BUFFER 4 
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THAN MAXIMUM LUMINANCE BY PREDETERMINED AMOUNT, AND OBTAIN 
AVERAGE VALUE (RH. GH, BH) OF RGB IN ITS AREA 
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Residence 7-1-33 6. Minami Ikuta 7-chome. Tama-ku. Kawasaki- shi , 
Kanacrawa - ken . Japan ; 



Post office Address c/o CANON KABUSHIKI KAISHA, 30-2, Shimomaruko 
3-chome. Ohta-ku. Tokyo. Japan 

Full Name of Third Joint Inventor, if any OS AMU YAMADA 

Third Inventor's signature 

Date Citizen/Subject of JAPAN 

Residence 5-20, Hicyashi Maqome 2-chome. Ohta-ku, Tokyo. Japan 



Post office Address c/o CANON KABUSHIKI KAISHA. 30-2, Shimomaruko 
3-chome, Ohta-ku. Tokyo. Japan 
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